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Abstract. In this paper, we study one kind of stochastic recursive optimal control problem with the 
obstacle constraints for the cost function where the cost function is described by the solution of one 
reflected backward stochastic differential equations. We will give the dynamic programming principle 
for this kind of optimal control problem and show that the value function is the unique viscosity 
solution of the obstacle problem for the corresponding Hamilton-Jacobi-Bellman equations. 
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1. Introduction. 

Nonlinear backward stochastic differential equations (BSDE in short) have been introduced by Par- 
doux & Peng [11]. Independently, Duffle & Epstein [6] introduced BSDE from economic background. 
In [6] they presented a stochastic differential recursive utility which is an extension of the standard 
additive utility with the instantaneous utility depending not only on the instantaneous consumption 
rate Ct but also on the future utility. Actually it corresponds to the solution of a particular BSDE 
associated with a generator which does not depend on the variable z. In mathematics the result in 
[11] is more general. Then El.Karoui, Peng and Quenez [10] gave some important properties of BSDE 
such as comparison theorem and applications in mathematical finance and optimal control theory. 
And also in this paper they gave the formulation of recursive utilities and their properties from the 
BSDE point of view. The recursive optimal control problem is presented as a kind of optimal control 
problem whose cost function is described by the solution of BSDE. In 1992, Peng [12] got the Bellman's 
dynamic programming principle for this kind of problem and proved the value function is a viscosity 
solution of one kind of quasi-linear second-order partial differential equation (PDE in short) which 
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is the well-known Hamilton- Jacobi-Bcllman equation. Then in 1997, he virtually generalized these 
results to much more general situation, even under Non-Markvian framework. (Sec in [13]). In this 
Chinese version, Peng used the backward semigroup property of BSDE to give a complete proof of the 
Bellman's dynamic programming principle for the recursive optimal problem introduced by a BSDE 
whose coefficient just satisfies Lipschitz condition, under Markovian and Non-Markovian framework. 
He also proved that the value function is a viscosity solution of a generalized Hamilton-Jacobi-Bellman 
equation. 

Then El.Karoui, Kapoudjian, Pardoux, Peng and Quenez [9] studied the reflected BSDE with one 
barrier. The solution of the reflected BSDE is forced to stay above one given continuous stochastic 
process which is called "obstacle" . For this purpose they introduced one increasing process to push 
the solution upwards in a kind of minimal way. They got the existence and uniqueness of the solution 
for this kind of reflected BSDE and also studied its relation with the obstacle problem for nonlinear 
parabolic PDE's within the Markov framework. Using two different methods, Snell envelope theory 
connected with fixed point principle and penalization method. Cvitanic and Karatzas [5] extended 
the result to reflected BSDE's with two barriers called upper and lower barriers, which are two given 
continuous processes. Hamadene and Lepeltier [7] generalized the results of El.Karoui et al [9] to 
one barrier which is right continuous and left upper semi-continuous. They used this model to solve 
the mixed optimal stochastic control problem when the terminal reward is only right continuous and 
left upper semi-continuous. In this kind of mixed control problem, the controller has two actions, 
one is of control and the other is of stopping his control strategy in view to maximize his payoff. 
Also in this paper Hamadene and Lepeltier generalized the result of Cvitanic and Karatzas ([5]) to 
reflected BSDE's with two barriers to processes S (lower barrier) and — U (U is upper barrier) merely 
right continuous and left upper semicontinuous. And then Hamadene, Lepeltier and Wu [8] proved 
existence and uniqueness results of the solution for infinite horizon reflected backward stochastic 
differential equations with one or two barriers. They also apply those results to get the existence 
of optimal control strategy for the mixed control problem and a saddle-point strategy for the mixed 
game problem when, in both situation, the horizon is infinite. 

In our paper, we study one kind of recursive optimal control problem with the obstacle constraints 
for the cost function. This means that the cost function of the control system is described by the 
solution of one reflected BSDE which is required to satisfy the obstacle constraints. This kind of the 
recursive optimal control problem has some practical sense such as, in financial market, the investor 
requires his recursive utility function value to be bigger than one specific function of his wealth. For 
this purpose, one increasing process is introduced to push the cost function value upward and we also 
hope this push power to be minimum. From the result in [9] and [7], we know that, in fact, this kind 
of problem is one mixed recursive optimal stochastic control problem. 

One of our interesting problem is that if the dynamic programming principle still holds for the 
above optimal control problem. Using some properties of the reflected BSDE and analysis technique 
we give the positive answer for this question. This result can be seen as the generalized extension of 
the dynamic programming principle of the recursive control problem in [12] and [13] to the obstacle 
constraints case for the cost function. And then, we show that, provided the problem is formulated 
within a Markovian framework, the value function is the unique viscosity solution of the obstacle 
problem for one nonlinear parabolic PDEs which is called Hamilton-Jacobi-Bellman (HJB in short) 
equations. 

The paper is organized as follows. In section 2, we present some preliminary results about re- 
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fleeted stochastic differential equations which play important role to study the dynamic programming 
principle of the optimal control problem. In section 3, we formulate the recursive optimal control 
problem with the obstacle constraints for the cost function and prove that the dynamic programming 
principle still holds. In section 4, we show that the value function of the control problem is the unique 
viscosity solution of the obstacle problem for corresponding HJB equations. In Appendix we put in 
some technique proof of the preliminary results of the reflected BSDE. 

2. Preliminary results of the reflected BSDE 

In this section, we give some preliminary results of the reflected BSDE which is useful to get the 
dynamic programming principle for the recursive optimal control problem with the obstacle constraints 
for the cost function. 

Let {Wt, < t < T} be a d— dimensional standard Brownian motion defined on a probability space 
(fi, T, P). Let < t < T} be the natural filtration of {IT*}, where Tq contains all P-null sets of 
T and let V be the er— algebra of predictable subsets of fi x [0, T]. 

Let us introduce some notation. 

L 2 = {£ is an Tt~ measurable random variable s.t. E(|£| 2 ) < +00} , 
H 2 = \^[ip t ,Q < t < T} is a predictable process s.t. E J \tpt\ 2 dt < +oo| , 



S = < {(f tl < t < T} is a predictable process s.t. E( sup \ipt\ ) < +00 

I 0<t<T 

and the following reflected BSDE with one barrier: 

Yt = C + J t g{s,Y s ,Z s )ds + K T -K t - J Z s dW s , 0<t<T. (2.1) 

Here £ e L 2 , g is a map from fix [0, T] xRx R d onto ft satisfying 

(i) V(2/,z)elRx]R d , g(;y,z)EH 2 , 

(ii) for some L > and all y, y' G R, z, z' G R d , a.s. 

\g(t, y, z) - g(t, y', z')\ < L(\y - y'\ - \z - z'\), 

an "obstacle" {S t ,0 < t < T}, which is a continuous progressively measurable real- valued process 
satisfying 

(hi) E (sup < t < T \S t \ 2 ) < +00. 

Then from Theorem 5.2 in [9], there exists unique solution {(Y t , Z t ,K t ), < t < T} taking values 
in R, R d and R + , respectively, and satisfying: 

(iv) Y G S 2 , Z G H 2 and K T G L 2 : 

(v) Y t >S t , < t < T; 

(vi) {K t } is continuous and increasing, K = and 



L 



T 

(Y t - S t )dK t = 0. 
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Now we give two more accurate estimates on the norm of the solution similar to Proposition 3.5 
and Proposition 3.6 in [9]. 

Proposition 2.1 Let {(Y t , Z t , K t ), < t < T} be the solution of the above reflected BSDE, then 
there exists a constant C such that 



| 4 sup r n 2 + £ \Z S \ 2 + \K T - ^t| 2 | < L 2 + ^J\(s,0,0)ds^ 



+ sup S 2 

t<s<T 



This proposition is similar to Proposition 3.5 in [9]. However, the estimate is more precise which 
is necessary to get the desired results in next section. The proof is a little complicated and technical, 
some technique derive from [2], we put it in the Appendix. 

And then, we need to estimate the variation of the solution induced by a variation of the reflected 
BSDE coefficients. 

Proposition 2.2 Let (£,g,S) and (£',g',S') be two triplets satisfying the above assumptions. Sup- 
pose (Y,Z,K) is the solution of the reflected BSDE (£,g,S) and (Y',Z',K') is the solution of the 
reflected BSDE (£',<?', 5")- Define 

A£ = £ - Ag = g - g' , AS = S - S'; 

AY = Y-Y', AZ = Z-Z', AK = K-K'. 
Then there exists a constant C such that 

E**| sup \AY s \ 2 + £ \AZ s \ 2 ds+\AK T ~ AK t \ 2 \ 



t<s<T Jt 



where 



< CE^ | |A£| 2 + (j* \Ag(s, Y„ Z s )\ds^ J + C (V' ^ sup^ \AS S 
*t,T = E* (|e| 2 + ( [ T \g(s,0,0)\ds] + sup \S S \ 2 

\ \Jt J t<s<T 

+\e\ 2 +( f T W(s,o,o)\ds) + sup \s: 

\Jt J t<s<T 



1/2 



* 1/2 



V |2 



The estimate of this proposition is more accurate than that in Proposition 3.6 in [9]. We also put 
the proof in the Appendix. 

3. Formulation of the problem and Dynamic programming principle 

In this section, we first formulate one kind of stochastic recursive optimal control problem with 
the obstacle constraints for the cost function, and then we prove that dynamic programming principle 
still holds for this kind of optimization problem. 
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We introduce the admissible control set U defined by 

U := {«(•) G H 2 \ v(-) take value in U C R fe } . 

[/ is a compact set, the element of U is called admissible control. 

For given admissible control, we consider the following control system 

(dX t /' v = b(s,X t /' v ,v s )ds + a(s,X t /' v ,v s )dW s , s G [t,T], 

I ^ C; " = c, (3 ' 1} 

here i > is regarded as the initial time, ( G L 2 (Q, T t , P; R") as the initial state, the mappings 

b : [0, T] x R" x [/ -> R™, cr : [0, T] x R" x U -> U nxd 

satisfy the following conditions: 

(H3.1) b and <r are continuous in t; 

(H3.2) For some L > 0, and all x, x 1 G R", u, t/ G [/, a.s. 

\b(t, x, v) — b(t, x' , v') \ + er(i, x,v) — a(t, x ,v )| < L(\x — x'\ + \v — v'\). 

Obviously, under above assumptions, for any v(-) G U, control system (3.1) has a unique strong 
solution {Xl'^' v , < t < s < T}, and we also have the following estimates: 

Proposition 3.1 For all t G [0,T], (,(' £ L 2 (ft,f(,P;R"), v(-),v'(-) eU, 

E*{ sup |X*^| 2 1 <C(1 + |C| 2 ); (3.2) 

lt<s<T J 

^ sup^ \X^ - A ;- ' -| < C|C - C'l 2 + CE* j jf |„ 8 - ^| 2 d s | , (3.3) 
where the constant C depends only on L. 

Proposition 3.2 For all t G [0, T], x G R™, v(-) G U, S G [0,T - t], 



E ^ sup \Xl' x ' v - x\ z ) < CS, (3.4) 

w/iere f/ie constant C depend only on x and L. 

Now for any given admissible control v(-) G W, we consider the following reflected BSDE 



F 8 ^ = $(X« ; '')+ /' g^X^X^^Z^^dr 

J s 

+ K f /' v - Kl't> v - / Z^dWr, t<s<T, 

J s 



(3.5) 



here 

$ = : R" -> R, /i = fc(t, a:) : [0, T] x R™ — > R, 

5 = y(i, y, z, i>) : [0, T] x R" x R x R d x U -> R 

satisfy the following conditions: 

(H3.3) g and h are continuous in t; 

(H3.4) For some L > 0, and all ar, a/ G R", y, y' £ R, 2, z' G R d u, i/ G {/, a.s. 

\g(t,x,y,z,v)-g{t, x',y',z',v')\ + |*(ar) - $(x')| + |/i(*,aO - 
< L(|x - a/| + |y - y'| + |z - z'| + |w - z/j). 

Then from Theorem 5.2 in [9], there exists a unique triple (Y t ^' v , Z t '^' v , K t '^' v ), which is the solution 
of reflected BSDE (3.5), satisfying 

(i) Y^O G S 2 , Z*^ v G if 2 and A /-' G /. ': 

(ii) F s *'^" > h(s,X*<<>), i < s < T; 

(hi) |A :- : ' | is increasing and continuous, A"j' C; " = 0, and jf (Y^ - h(s, X*>0))<£Fr*>0 = 0. 
Moreover, we can get the following estimates for the solution of (3.5) from Proposition 2.1 and 2.2. 



Proposition 3.3 

E^< 

Proposition 3.4 



{ sup \Y^\ 2 + f \Z^\ 2 ds + \K^A <C(l + \(\ 2 ). (3.6) 

[t<s<T Jt J 



rt£;v iftX'-y |2 

Lrp II rp 



Ef* I sup \Y^' V - | 2 + / |Z*<<> - Z*> c >' | 2 ds + \K\ 

\t<s<T Jt 

< C\( - Cf + CE^' j \v s v'fds^ (3.7) 

+ c(i + id + ici) ^ic-ci 2 + y t T \v s - <i 2 ^|^ . 

Given the control process v(-) G we introduce the associated cost functional: 

J{t,x;v{-)) := ^"1,=*, (t.z) G [0,T] x R", (3.8) 
and we define the value function of the stochastic optimal control problem 

u(t,x) := ess sup J(t,x;v(-)), (t,x) G [0,T] x R™. (3.9) 

»(■)£« 

This is one kind of stochastic recursive optimal control problem with the obstacle constraints for 
the cost function: Y*' x ' v > h(s,Xl' x ' v ), t < s <T. In financial market, if X t s ' x ' v represents the wealth 
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of the one investor , Y*' x ' v : the recursive utility cost function, the constraint is that the investor 
requires his cost function value to be bigger than one function of his wealth at any time. 

Remark 3.5 From Proposition 2.3 in [9] and the definition in [7] and [8], we know that the above 
optimal control problem is one recursive mixed optimal control problem: 

u(t,x):=ess sup Y*' x ' v = ess sup ess sup E^' < f g(s, X l /' v , Yf& v , Z f /' v , v s )ds 
v(-)eu v(-)eu reT t [Jt 

+ h{X t T ^)lr<T + HX t T C ' V )U= T } 

where T is the set of all stopping times dominated by T and T t = {r G T; t < t < T}. 

In this kind of recursive mixed control problem, the controller has two actions, one is of control 
v(-) and the other is of stopping his control strategy in view to maximize his recursive payoff. The 
more detail about this kind of problem can be seen in [9] , [7] and [8] . 

Now we continue to study the former control problem (3.9) and show that celebrated dynamic 
programming principle still holds for this kind of optimization problem. The main proof idea comes 
from the proof of dynamic programming principle for recursive problem given by Peng in Chinese 
version [13]. 

For each t > 0, we denote by {J-^,t < s < T} the natural filtration of the Brownian motion 
{W s —Wt,t < s < T}, augmented by the P-null sets of T and we introduce the following subspaces 
of admissible controls 

U l := {v(-) G U | v(s) is {J-l} progressively measurable, Vf<s< T.} 
W* := |u s = Yl I V 3 , G U\ {Aj}f =1 is a partition of (SI, T t ). 

Firstly we will show that 

Proposition 3.6 Under the assumptions (H3.1)-(H3.4), the value function u(t,x) defined in (3.9) is 
a deterministic function. 

Proof: Firstly , we will show 

ess sup J(t, x; v(-)) — ess sup J(t,x;v(-)). (3.10) 

v(-)eu v(-)ew* 

Obviously, 

ess sup J(t, x; v(-)) > ess sup J(t, x;v(-)). 
v(-)eu «(-)ew* 

we need to show the inverse inequality. Ve > 0, there exists v(-) G U such that 
P I J(t, x\ v(-)) > ess sup J(t, x; v(-)) — e > = 5 > 0. 

{ v(-)&4 J 
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From (3.7), we know Vu(-) £ U\ 

E ^ Y t, X ;v _ Y t,x-,v^ <Ce£ \v s -v s \ 2 ds + C(l + x) (e£ \v s -i s \ 2 ds\ . 



Note that U l is dense in U, then there exists a sequence {v n (-)}^ =1 £ U l such that 

lim e(|F/' x; "" -Y*' x *\ 2 \ =0. 
Then, there exists a subsequence, we denote without loss of generality {v n (-)}^ = i a l so ; sucn that 



lim Y*< x *» = Y*'^ a.s., 

n— »co 



then 



nun i^--^i<i =1 

m=l AT=1 n=N k J / 

(CO CO s "\ \ 

|J n -y/^|<ll = 

N—l n—N L mJ / 

lim P f f] Jly.*^" -r t M;5 | < 11 I : 



1, Vm £ IN, 
= 1, Vm G IN, 



lim P \ \Y^ V - - y t *> x;C | < - 1 = 1, Vm e IN. 
We select m. big enough such that 1 /m < e and denote 



A = i uj\Yt' x ' v > ess sup J(t, «(•)) — e S ; 
! ' v(-)eu ) 



*!<-} 
m J 



^ = <jw||F t *^ ;t,iv -y/>^| < _L [> , JV = 1, 2, ■ . 



then, from above definition, -P(-A) = 5 > and limjv^oo P(Bn) — 1. We select AT big enough such 
that P(-Bat) > 1 - <5, then 

P(APw) = P{A) + P{B N ) - P{A U B N ) > 5 + (1 - 8) - 1 = 0. 

It is easily to check 

P J yM;™ > ess sup g.. v ^ 2 £ I > P(APAr) > 0. 



This inequality implies 



1 1 

v(-)eii 



ess sup J(t, x; «(•))> ess sup J(t,x;v(-)) — 2e. 



From the arbitrariness of e, we get 



Then we obtain (3.10). 
Secondly, we will show 



ess sup J(t, x; «(•)) > ess sup J(t, x; «(•))• 

»(•)£«* w(-)€W 



ess sup J(t,x;v(-)) = ess sup J(t,x;v(-)) (3-11) 



Obviously, 

ess sup J(t, x; «(•)) > ess sup J(t,x;v(-)). 
v(-)eW »(•)£«' 

We need to show the inverse inequality also. 

Let us admit for a moment the following lemma. The main idea of the lemma is to consider the 
partition of probability space, which is first introduced by Theorem 4.7 in [13]. 

Lemma 3.7 



JV AT 

Vu(-) we have 

AT AT 

j(t, x- «(.)) = ^ ^ (-)u 3 ) = £ u, J (*> ^'(O)- 

Note that «•?(•) are {.T 7 *} progressively measurable, then J(t, x; v j (■)) (j = 1, 2, • • • , JV) are determin- 
istic. Without loss of generality, we assume that 

J{t,x-y{-))>J{t,x-y{-)), Vj = 2,3,--- ,JV. 

So that 

J(f, x; «(•)) < J(i, x; w 1 (-)) < ess sup J{t,x;v{-)). 

v(-)eu* 

From the arbitrariness of v(-), we get 

ess sup J(t,x;v(-)) < ess sup J(t,x;v(-)), 

and obtain (3.11). 



However, when v(-) e U*, the cost functional J(t,x;v(-)) is deterministic, so 

u{t,x) — sup J(t, x;v(-)) 
v(-)ew 

is deterministic and the proof is completed. □ 

We need to give 
Proof of Lemma 3.7 For every j = 1, 2, • • ■ , TV, we denote 

(Xi,Yj,Z$,Ki) ee (Xl^ 3 ,Y^ 3 ,Zl^\Kt^ 3 ). 
Xi is the solution of the following stochastic differential equations: 

Xi=x+ [ b(r,Xi,4)dr+ f a(r,Xi,4), s e [t,T]. 
Jt Jt 

(F- 5 , Z^, A^') satisfies the following reflected BSDE: 

r s J = $>{X° T ) + / 5 (r, X^,Yj , Z 3 r , v r )dr + K J T - K{ - f Z 3 r dW r , s <E [t, T]; 

J s J s 

Yj > h(s, XI), s e [t, T]; J\y> - h(s, Xi))dK{ = 0. 

We multiply \ Aj on the both sides of the above equations, then sum the equations. From the trivial 
fact: 

zZ 1a M x j) = <P(}2 x i lA ^> 

j 3 



we get 

N „, N N „ s N N 



£ l Aj Xi = x + f b(r, £ U,^', £ ^X) dr + / S CT ( r ' E E ^ 

i=i * i=i j=i * j=i i=i 

AT AT T AT AT JV N 

j2u 3 yi = <p(J2 1 ^ x t)+ / ^E^^'E^^'E^^'E 1 ^^ 

j=i j=i Js j=i i=i i=i i=i 

jv at t j\r 

+E 1 ^r-E 1 ^-/ E 1 > z - 

.7 = 1 .7=1 J;S .7=1 



)dVF r 



AT AT r T ( N 

Eu^>m-,E 1 ^); / E 
j=i j=i * \j=i 



AT \ I N 

l Aj Yi h(s, U,Xi) \d\J2 l A 3 Kl ] = 0. 
i=i / \j=i 



Then from the uniqueness of the solution of stochastic differential equations and reflected BSDE, we 
get the conclusion. □ 
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We next will discuss the continuity of value function u(t, x) with respect to x. We have the following 
estimation: 

Lemma 3.8 For each t £ [0,T], x and x' G R™, we have 

(i) \u{t, x) - u(t, x')\ 2 < C\x - x'\ 2 + C(l + \x\ + \x'\)\x - x'\; 

(ii) \u(t,x)\<C(l + \x\). 

Proof: From estimation (3.6) and (3.7), for each admissible control v(-) G U, we have 

\J(t,x;v(-))\<C(l + \x\); 

\J{t, x- «(■)) - J(t, a/; v(-))\ 2 < C\x - x'\ 2 + C{\ + |z| + \x'\)\x - x'\. (3.12) 
On the other hand, for each e > 0, there exist v(-) and ?/(•) eM such that 

J(t, x; «'(•)) < a;) < J(i, cc; v(-)) + e, 
J(i, a;'; v(-)) < u(t, x') < J(t, x'\ ?/(•)) + e. 

Then from the estimation of J, we get 

-C(l + |ar|) < J(i, a; «'(•)) < u(i,a;) < J(t, x; «(•)) + e < C(l + |x|) +e. 

From the arbitrariness of e, we obtain (ii). Similarly, 

J(i, x; ?/(•)) - J(i, a;'; </(•)) - e < a;) - a;') < J(i, a;; «(•)) - J(i, a;'; «(•)) + e, 

a;) — u(t, a;') | 

< max{| J(t, a;; «(■)) - J(t,a/;«(-))|, !■/(*, a;; </(•)) - J(t, x';v' (■)){} + e, 
\u(t,x) - u(t,x')\ 2 

< 2max{\J(t,x;v(-)) - J(t,x';v(-))\ 2 ,\J{t,x;v'{-)) - J(t,x';v'{-))\ 2 } + 2e 2 

< 2C\x - x'\ 2 + 2C(1 + \x\ + \x'\)\x - x'\ + 2e 2 . 

The we can obtain (i). □ 
We also have 

Lemma 3.9 Vt G [0,T], Vu(-) G W, /or aZZ C G £ 2 (^, -T 7 *, P; R"), we ftoue 

J(t, <>(•)) =1?^. 

Proof: We first study the simple case: C has the following form: 

N 

i=i 
ii 



where {-A}^ is a finite partition of (O, Ft), and Xi £ R™, for 1 < i < N. The similar argument as 
Lemma 3.7 leads to 

JV N 

yt,C;v = y s *'^=i = \ A Yl^\ s g [t,T]. 

»=i 

From the definition (3.8), we deduce that 

N N N 

y/'O = E u^ 3 ^ = E l ^ J ^ <)) = J ^ E l * x « »(•)) = J (*' c; «(•))• 

i— 1 i— 1 i— 1 

Therefore, for simple functions, we have the desired result. 

Given a general £ <E L 2 (f2, .T^, P; R"), we can choose a sequence of simple functions {Q} which 
converges to ( in L 2 (Q, T t , P; R n ). Consequently, from the estimate (3.7) and (3.12), we have 

E{|r/^-y/^| 2 } 

<E{c|c-Ci| 2 + C(i + KI + |Ci|)K-Ci|} 

<ce{|C-0I 2 }+c(e{(i + |c| + |C 4 |) 2 }) 1/2 (E{|C-CI 2 }) 1/2 

— > 0, as i — > oo, 

E{|j(t,C;<)) -•/(*, C*X0)l 2 } 
<E{C|C-Cd 2 + C(i + |CI + IC,|)IC-CI} 

< CE {|C - CI 2 } + C (E {(1 + |C| + ICI) 2 }) 172 (E{|C - Ci| 2 }) 1/2 
— ► 0, as i — > oo, 

and Yt'^ i,v = J(t,Q;v(-)), the proof is completed. □ 

For the value function of our recursive optimal control problem, we have 
Lemma 3.10 Fixed t g [0, T) and ( g L 2 (Q, P; R"), /or eac/i w(-) g we ftaue 

u^C)^*?^- (3.13) 
On the other hand, for each e > 0, there exists an admissible control v(-) g U such that 

u(t, C) < Y t tX;v + e, a.s.. (3.14) 
Proof: We first prove (3.13). When ( is a simple function: 

AT 

C = E l M x U 
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for all v(-) £ U, we have 

N N N 

i=l i=l 

When ( e L 2 (£l, .T^, P; lR n ), we can choose a sequence of simple functions {Q} which converges to 
( in L 2 (il, Tt-, P; R n ). Consequently, similarly with Lemma 3.9, we have 

E {|yU;, _ ^,C (! «|2 j ^ Q . E {| u(t)C) _ u (tXd\ 2 } - 0. 
Then, there exists a subsequence, we use same notation without loss of generality also, such that 
lim Yf'^ % ' v = Yf' v , a.s. lim u(t, Q) = u(t, £), a.s. 

here Y t tXi '' v < u(t, Q), i = 1, 2, • • • , so F t *' C; " < u(t, C). 

We turn to prove (3.14). We first deal with the case that £ is a bounded random vari- 
able: ( S i oo (0,^ 7 t ,P;R™). We suppose that |C| < M and construct a simple random variable 
7] e L°°(n,F u P;B. n ) 

N 
i=l 

such that 

(i) M < ICI; 

(ii) It? -C| <un^{^-, 36C( f +2M) y 
For any w(-) G U, we have 

|y t *.Ci»_y^|<£. \ u (tX)-u(t, V )\< £ -. 
Then for each Xj, we can choose an {J 7 *}— adapted admissible control v % (-) such that 

u{t,x i )<Y t ^ + £ -. 

We denote 

iV 

v(-) :=£uy(.), 

i=l 

then 

AT 

yjt,C;t> > _ y/^"| + y*™ v > -- + V Ia,*?'*'"" 

3 j= i 

£ W e 2 

> -3 " 3) = _ 3 e+u (*' r ?) 

> -£ + u(i,C)- 
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Therefore, for C G L°°(0, T u P; R"), we have the desired result (3.14). 

Given a general £ £ £ 2 (^, Ft,P', R n ), we note that ( have the following form: 

oo 

»=i 

where {^Oi^i is a partition of (fi, J^), x, e R" (i = 1, 2, • • • ), < i and Q £ jF t , P; R"). So, 

for every there exists «*(•) e ZY, such that 

oo 

«(-) = Euy(-), 



We denote 



i=l 



and then 



i— 1 z — 1 i— 1 

oo 
i=l 

The proof is completed. □ 

Now we start to discuss the (generalized) dynamic programming principle for our recursive optimal 
control problem (3.9). In [13], Peng first used the idea of (backward) semigroups of BSDE to prove 
the dynamic programming principle for the recursive optimal control problem associated to BSDE. 

Firstly we introduce a family of (backward) semigroups which come from Peng's idea [13]. 
Given the initial condition (t,x), an admissible control v(-) € U, a positive number 6 <T — t and 
a real-valued random variable r] G L 2 (Sl, J^t+s, P', R), we denote 

where (Y s , Z s , K s ) t < s <t+s is the solution of the following reflected BSDE with time horizon t + 5 

rt+5 

Y S = V + g(r, Xp x > v , Y r , Z r , v r )dr + K t+S - K s 

J s 



I 



t+S 

Z r dW r , t<s<t + S, 



satisfying 

(i) Y eS 2 , Z e H 2 and K t+S E L 2 ; 

(ii) Y s > h{s,Xl> x ' v ), t<s<t + S; 



(iii) {K s } is increasing and continuous, K t — 0, J t (Y s — h(s, Xl' x;v ))dK s = 0. 
Obviously, 

Gt,x;vr*L/ v t,x;v\-\ r it,x:v r v i,j;oi 
t,T l 9 ( A T )\ - ^t.t+S^t+S J- 
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Then our (generalized) dynamic programming principle holds. 

Theorem 3.11 Under the assumptions (H3.1)-(H3.4), the value function u(t,x) obeys the following 
dynamic programming principle: For each < S < T — t, 

u(t,x) = ess sup + (3.15) 

v(-)eu " 

Proof: We have 

u(t,x)=ess sup G tT ' [${Xj )] = ess sup G tt+s [Y t ^ s ' } 
v(-)eu v(-)eu 

= ess sup G^ 5 \Y^ X " r ,v ]. 
v(-)eii 

From Lemma 3.10 and the comparison theorem of reflected BSDE (Theorem 4.1 in [9]), 

u(t,x)<ess sup Gl't+ S [u(t + 5, Xl'*£ v )]. 
v(-)eu ' 

On the other hand, for every e > 0, we can find an admissible control v(-) £ U such that 

u(t + 6,X^n<^ 5 S ' X ^ TiV +e. 

From this and the comparison theorem, we get 

u(t, x) > ess sup G t 't+ S [u(t + 5, X^'fg V ) — e]. 
v(-)eu " 

From Proposition 2.2, there exists a positive constant Co such that 

u(t, x) > ess sup G t '*+ g 
v(-)eu 

Therefore, letting e J. 0, we obtain the equation (3.15). □ 

At the end of this section, we devote ourselves to obtaining the continuity of u(t, x) with respect 
to t. 

Proposition 3.12 The value function u(t,x) is continuous in t. 

Proof: We define Y*' x ' v for all s £ [0,T] by choosing Y*' x ' v = Y{' x > v for < s < t. And we define 
the "obstacle" 

' h{s,Xt^)-t<s<T- 
h(t,x); 0<s<t. 



Fixed x £ R™, for all < t\ < ti < T, we analysis the difference of u(t\, x) and u(t 2l x) 
Ve > 0, there exist v\{-) £ U, v 2 (-) £ U, such that 

15 



Then, 

ytux;v 2 _ yt 2 ,x;v 2 _ £ < u ^ x) _ u ^ x) < y^,*;^ _ y^,*;^ + ^ 

!«(*!, a;) - «(t 2)a: )| < max^ 1 '^ 1 - Y%™\, \Y£™ - Y%™\} + e. 

Here we only estimate \Y t \ uX ' Vl - Y t \ 2 ' x ' Vl \ and the estimate of \Y t \ uX ' V2 - Y t t2 ' x ' V2 \ is same. From 
Proposition 2.2, we have 

\ v ti,x-,vi v t 2 ,x;vi i2 _ | v ti,x;vi \rt 2 ,x\v\i 2 
\ 1 t 1 I t 2 I — \ 1 *Q I 

<e( sup \Y^' X ' V1 -Y s t2 ' x ' Vl \ 2 \ 

[o<s<T J 

< CE{\$(Xp' XiVl )-$(x!*> x,Vl )\ 2 } 
+ CE | ^ jf \l [tuT] g(s, X^ , , Zt>™ , Wl («)) 

- l [t2 , T] 9(s, , , Z?™ , Wl (a)) \ds) 2 } 

1/2 



(3.16) 



+ C< 2 (e( sup \St» x ^-Sl* 

' \ {0<s<T 



x\v\ |2 



where 



*o,t = E I |$(X*™)| 2 + ^ X 8 «™, 0, 0, Vl (s))\ds 
+ sup |fc(*,X^ 1 )| 2 + |$(x£' Xi,,1 )| 2 

t!<S<T 



+ 1 



f | 5 ( S ,X^,0, 0,^00)1^] + sup \h(s,Xl 2 ' x ' Vl )\ 2 

JU / t 2 <s<T 



Now we deal with the items for the right side of inequality (3.16). 

The first item: From Lipschitz condition, Proposition 3.1 and Proposition 3.2, we get 

/ < CE{\X%> X,V1 -X%' x '' Vl \ 2 } < CE{\X%> x,Vl -x\ 2 } < C(t 2 -h). 

The second item: From Lipschitz condition, (a + b) 2 < a 2 /2 + b 2 /2, Proposition 3.1, Proposition 
3.2 and Proposition 3.3, we get 

II<C{t 2 -h). 
The third item: As the same argument we get 

*o,t < C. 

We next discuss 

\ S n,x m _ s t 2 ,x- m] 2 = \fi^x^' x ' vi ) -h(s,Xl 2 ' x ' m )\ 2 

< C\X^' x ' Vl -X* 2 ^" 1 ! 2 ; s e [t 2 ,T], 
16 



IS*!,*;*! _ S t 2 ,x:v 1 \2 = \ h ^ : X^ X ^) -h(t 2 , X )\ 2 

< C\X^ X ^ - x\ 2 + 2\h{s,x) - h{t 2 ,x)\ 2 ; se [t u t 2 ] 
- Sl^\ 2 = \h(t u x) - h(t 2 ,x)\ 2 ; s G [0,ti]. 

So we have 

e( sup |S , * 1 ' x; " 1 -S*^ 1 ! 2 

[o<s<T 

<E(f sup + sup + sup ) IS 1 * 1 '^ 1 -5* 2 ' x;,,1 | 2 } 

I \0<s<ti ti<s<t 2 t 2 <s<T J J 

<C(t 2 -ii) + |^(ii,a:)-/i(t2,a;)| 2 +2 sup |/i(s, x) - h(i 2 , x)\ 2 

t!<S<t 2 

<C(t 2 -h)+3 sup |/i(s,x) - h(t 2 ,x)\ 2 . 

ti<s<t 2 

From the above analysis , we know 

\ Y £<*™ -Y%< x;vi \ 2 <C{t 2 -h) + 3 sup \h(s,x)-h(t 2 ,x)\ 2 , 

t 1 <s<t 2 

|y t ti,^i_y t * 2 ,^i|< c(t2 _ tl) i/2 + 3 sup |/j( a>a; )_ fe ( t2)a: )|. 

ti<s<t 2 

The same argument used to \Y^' X > V2 - Yg'*'" 2 ] 2 leads to 

|u(ii,a;) - u(t 2 ,x)\ < C{t 2 - h) 1/2 + 3 sup \h(s,x) - h(t 2 ,x)\ +e. 

tl<S<t 2 

Because of the arbitrariness of e, we get 

\u(t 1 ,x)-u(t 2 ,x)\<C(t 2 -t 1 ) 1 / 2 +3 sup \h(s,x)-h(t 2 ,x)\. 

ti<s<t 2 

From the continuity of h(t, x) with respect to t, we get the continuity of u(t, x) with respect to t. The 
proof is completed. □ 

4. Viscosity solution of an obstacle problem for HJB equations 

In this section, we relate the value function of above recursive optimal control problem with the 
following obstacle problem for nonlinear second-order parabolic PDEs which is called Hamilton-Jacobi- 
Bcllman equations: 

min (u(t, x) — h(t, x), 

— 7T-(t, x) — sup {£(t, x, v)u(t, x) + g(t, x, u(t, x), Vu(t, x)a(t, x, v), v)} ) = 0, (4.1) 
ot v eu 

[u(T,x) = *(x), 
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where £ is a family of second order linear partial differential operators, 

C(t, x, v)<p = ^Tr ((<7<7 T )(t, x, v)D 2 ip) + (b(t, x, v),Dip). 

Here the function b, a, g, $, h are supposed to satisfy (H3.1)-(H3.4), respectively. 

We want to prove that the value function u(t, x) introduced by (3.9) is the unique viscosity solution 
of the obstacle problem for HJB equation (4.1). We first recall the definition of a viscosity solution 
for HJB equation obstacle problem (4.1) from [4]. Below, S n will denote the set ofnxn symmetric 
matrices. 

Definition 4.1 Let u(t,x) G C((0,T) x R") and (t,x) G (0, T) x R™. We denote by V 2 - + u(t,x) [the 
"parabolic superjet" of u at (t,x)] the set of triples (p,q,X) efix R™ x S n which are such that 

u(s,y) < u(t,x) +p(s -t) + (q,y - x) + ^(X{y -x),y-x} + o(\s -t\ + \y- x\ 2 ). 

Similarly, we denote by V 2 '~u(t,x) [the "parabolic subjet" of u at (t,x)] the set of triples (p,q,X) G 
R x R" x S n which are such that 

u(s,y) > u(t,x) +p(s - t) + (q,y - x) + ^(X{y -x),y-x} + o(\s -t\ + \y- x\ 2 ). 

Example 4.2 Suppose that ip e C^ 2 ((0, T) x R"). If u — ip has a local maximum at (t, x), then 

(j£(t, x), V<p(t, x), D 2 <p(t, x)j E V 2 - + u{t, x). 
Ifu — ip has a local minimum at (t,x), then 

d(f -(t,x),V(p(t,x),D 2 tp(t,x)] e V 2 -~u{t,x). 



dt 

We can now give the definition of a viscosity solution of the HJB equation obstacle problem (4.1) . 
Definition 4.3 

(a) It can be said u(t,x) G C([0,T] x R") is a viscosity subsolution of (4-1) ifu(T,x) < &(x), 
x G R™, and at any point (t, x) G (0, T) x R™, for any (p, q, X) G T' 2,+ u(t, x), 

min (u(t, x) — h(t, x), —p — sup { -Tr(aX) + {b, q) + g(t, x, u(t, x), qcr(t 7 x, v), v) \ ) < 0. 
V veu 12 J J 

In other words at any point (t,x) where u(t,x) > h(t,x), 

-p - sup { ^Tr(aX) + (6, q) + g(t, x, u(t, x),qa(t, x, v), v) \ < 0. 
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(b) It can be said u(t,x) E C([0, T] x R") is a viscosity supersolution of (4-1) ifu(T,x) > &(x), 
x E R™, and at any point (t, x) E (0, T) x R™, for any (p, q, X) E V 2 ^u(t, x), 

min (u(t, x) — h(t, x), —p — sup { -Tr(aX) + (b, q) + g(t, x, u(t, x), qcr(t, x, v), v)\ J > 0. 
V veu 12 ) J 

In other words, at each point, we have both u(t,x) > h(t,x) and 

-p - sup { ^-Tr(aX) + (b, q) + g(t, x, u(t, x),qa(t, x, v), v) 1 > 0. 
veu I ^ J 

(c) u(t, x) E C([0,T] x R") is said to be a viscosity solution of (4-1) if it is both a viscosity sub- 
and supersolution. 

We are going to use the approximation of the reflected BSDE by penalization, which was studied 
in section 6 of [9]. For each (t,x) E [0, T] x R n , n E IN, let {{ n Y^ v , n Zl^ v ),t < s < T} denote the 
solution of the BSDE 

nyt, X ;v = ^j^") + f g{r, Xp x,v , n Y*' x ' v ,™ \v r )dr 

J s 

+ n( ( n Y*' x ' v — h(r, X*' x ' v ))~ dr - f n Zl' x > v dW r , t<s<T. 

J s J s 

We define 

J n (t, x; v(-)) :=" Yf' x,v , v(-) E U, < t < T, x E R"; (4.2) 

u n (t, x) := ess sup J n (t, x; «(•)), < t < T, x E R™. (4.3) 

v(-)eu 

It is known from [12] or [13] that u n (t,x) defined in (4.3) is the viscosity solution of the PDE 
du 

~ "arC*'^) _ snp{£(t,x,v)u n (t,x) + g n (t, x, u n (t, x), Vu n (t, x)a(t, x, v), v)} = 0, 
at v( zu 

u n (T,x) =&(x), 
where 

g n (t, x, r, pa(t, x, v), v) = g(t, x, r, pa(t, x, v),v) + n(r - h(t, x))~ . 

Then 

Lemma 4.4 u n (t,x) | u(t,x), < t < T, x E R n . 

Proof: From the result of the section 6 in [9], for each < t < T, x E R™, 

J n (t, x; v(-)) | J(t, x; v(-)), as n — > oo. 

From the monotonic property of J„ and the definition of u n in (4.3), we get the monotonic property 
of u n . Next we will show the convergent property of u n . 

For each < t < T, x E R", Ve > 0, there exists v(-) E U such that 

u(t,x) < Y^+e, 
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then 

< u(t,x) - u n {t,x) < Y*' xro - n Y* <XiV + e. 
Because n Yf x ' v T Y*' x;i ', a.s., we take limit on both side, 

< limsup(u(t, x) — u n (t, xj) < e. 

n — >oo 

From the arbitrariness of e, we get the desired result. □ 

Remark 4.5 Since u n and u are continuous, it follows from Dini's theorem that the convergence in 
the lemma is uniform on compacts. 

Theorem 4.6 Defined by (3.9), u is a viscosity solution of HJB equations (4-.1). 

Proof: We now show that u is a subsolution of (4.1). Let (t, x) be a point at which u(t, x) > h(t, x), 
and let (p,q,X) £ T ,2 ' + u(t,x). 

From Lemma 6.1 in [4], there exists sequences 

rij -> +oo, (tj,Xj) -> (t, x), (pj,q h Xj) £ V % +u nj {tj,Xj), 

such that 

(Pj,Qj, x j) -» (p,q,x). 

But for any j, 

- pj - sup { -Tr(aXj) + (b, q 3 ) + g(tj,Xj,u n (tj,Xj),qja(tj,Xj,v),v) 
veu L A 

+n j (u nj (t j ,x j ) - h(tj,Xj))-} < 0. 

From the assumption that u(t,x) > h(t,x) and the uniform convergence of u n , it follows that for j 
large enough u n . (tj,Xj) > h(tj,Xj), hence 

-Pj - SU P { \ Tr { aX j) + {°i Qj) + 9(tj,Xj,u nj {tj,Xj), qja(tj,Xj,v), v) \ < 0. 
veu I * J 

Let us admit for a moment the following lemma. 
Lemma 4.7 

lim sap\)-Tr{aXj) + (b, qj ) +g(t j ,x j , u n (tj,Xj), qj<j{tj,Xj,v), v) 
= sup lim j ^-Tr(aXj) + (b, q 3 ) + g{t^x h u n {tj,Xj), qja(tj,Xj,v), v) \ . 
Taking the limit as j — ► oo in the above inequality yields: 

-p- sup \^Tr(aX) + (b, q) +g(t,x,u(t, x), qa(t, x, v),v) } 0. 



veu 
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and we have proved that u is a subsolution of (4.1). 

We now show that u is a supersolution of (4.1). Let (t,x) be an arbitrary point in (0, T) x R™, 
and (p, q, X) G P 2 -~u(t,x). We already know that u(t,x) > h(t,x). By the same argument as above, 
there exist sequences: 

rij -> +oo, {tj,Xj) -> {t, x), (pj,qj,Xj) G V 2 '~u nj (tj,Xj), 

such that 

{pj, qj ,Xj) -> (p,q,X). 

But for any j, 

- pj - sup j ^-Tr(aX,) + (b, q ) + g(t J ,x j ,u nj (tj,Xj),qja(tj,Xj,v),v) 
veu L * 

- h(tj,Xj))-} > 0. 

Hence 

-pj - sup <^ -Tr(aXj) + {b, q 3 ) + g(tj,Xj,u n {tj,Xj), qj a(tj,Xj,v), v) \ > 0, 
veu I 2 J 

and taking the limit as j — > oo, we conclude that: 

-p - sup j ]-Tr{aX) + (b, q) + g(t, x, u(t, x), qa(t, , v), v) \ > 0. 
veu I ^ J 



Now we turn to 
Proof of Lemma 4.7 For the convenience, we denote 

fj(v) = ^Tr(a,Xj) + (b, qj ) + g(t j ,x j ,u nj (t j ,x j ),q j a(t j ,x j ,v),v). 

Firstly, Vw G [7, 

< sup lim /,•(«) < liminf sup fj(v), 

veU l^oo J^oo veU 

then 

sup lim fj(v) < liminf sup fj(v). (4.4) 

ve u j *°° veu 

Secondly, we consider a subsequence {jk}kLi such that 

lim sup fj k (v) = lim sup sup fj (v). 

Ve > 0, Vjfe, 3vj k G U such that 

sup/ Jfc (w) < f jk (v jk )+s. 
veu 
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Because U is compact, there exists a convergent subsequence denoted by {vj k } < ^' =1 also, the limit is 
denoted by v . We consider the difference of fj k (vj k ) and fj k (vo): From the Lipschitz condition we 
get 

- fj k (vo)\ < C\v jk - v \ 2 + C\v jk - v \, 
where C only depend on the Lipschitz constant. It follows that for jk large enough 

\fj k (vj k ) ~ fj k (vo)\ < e. 

Then 

sw Pfj k ( v ) < /j fc M + 2e, 
veu 

lim sup sup /,■(?;) = lim sup f jk (v) < lim f jk (v ) + 2s= lim fj(v ) + 2s, 

j^oc vEU Jk^ca v eU jk^oo j^oo 

lim sup sup fj(v) < sup lim fj(v ) + 2e. 
j->oo veu veu 

From the arbitrariness of s, 

lim sup sup fj (v) < sup lim fj(vo). (4.5) 
j^oc veu veui^°° 

From (4.4) and (4.5), wc complete the proof. □ 

Finally, we shall use some technique and method from [1] to establish a uniqueness result for 
viscosity solution of (4.1). This kind of technique and method can also be seen in [3] to prove the 
uniqueness for viscosity solutions of Hamilton-Jacobi-Bcllman-Isaacs equations related to stochastic 
differential games. 

Lemma 4.8 Let m E C([0,T] x R") be a viscosity subsolution and u 2 G C([0, T] x R") be a 
viscosity supersolution of (4-1)- Then the function w := u\ — u 2 is a viscosity subsolution of the 
system 

(dw \ 
w(t, x), — -— (t, x) — sup {C(t, x, v)w(t, x) + L\w\ + L\Vwa(t, x, v)\}\ = 0, 
ot ve u J (4.6) 

w(T, x) = 0, 

where L is the Lipschitz constant of g in (y,z). 

Proof: The proof is similar to that of the corresponding results: Lemma 3.7 in [1]. 

For each (t , x ) £ (0, T) x R", let ip e C°°([0, T] x R") and let (t , x ) be a strict global maximum 
point of w — ip. Because ui is a viscosity supersolution of HJB equation (4.1), we have 1*2(^0, ^o) > 
h(to,x n ). If ui(t n ,x ) < h(to,Xo), it is easily to get 

w(t ,x ) = ui(t ,x ) - u 2 (to,x Q ) < 0, 

and we get the desired result. Therefore, in the proof, we suppose that u(to,x a ) > h(to,Xo). 
We introduce the function 

\x — y p 

$e(t,x,y) = ui(t,x) - u 2 (t,y) $ vit,^), 
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where e is a positive parameter which is devoted to tend to zero. 

Since (to, %o) is a strict global maximum point of u± — u 2 — (p, by a classical argument in the theory 
of viscosity solutions, there exists a sequence (t, x, y) such that 

(i) (t, x, y) is a global maximum point of $ e in [0, T] x Br x Br where Br is a ball with a large 
radius R; 

(ii) (t,x), (t,y) -> (t ,x ) as e -> 0+; 

(iii) |x £ a is bounded and tend to zero when e — > + . 

We have dropped above the dependence of i, x and y in e for the sake of simplicity of notations. 
It follows from Theorem 8.3 in [4] that, V<5 > 0, there exist 



+ Dcp,X) eV 2 >+ Ul (t,x), [P--jfi, — ,Y) £V 2 >-u 2 (t,y), 



such that 



X 
-Y 



<A + 5A 2 , (4.7) 



where 

2 2 



Calculating directly, we get 



After given e, S > 0, we have 



p - sup \ ^Tr ((<ra T ){i, x, v)X) + (b(i, x, v), 2 ^ 2 ® + D<p(i, x)) 



/ 2(x — y) - - \1 

+5 I i,x ,m(t,i), [ — \- Dtp(t,x)]cr(t,x,v),v J > < 0, 

p- - sup/Vr ((a ( x T )(£,y, U )y) + ( 6 (t,y, v ),fc^> 



veu 



+9 (i,y,U2(i,y), 2 ^ g2 — v{i,y,v),vj^ > 0. 

The first inequality minus the second one, 

- x) - sup ( 1 (Tr ((aa T )(£, x, v)X) - Tr ((aa T )(t, y, v)Y)) 

at ti£[j 

+ (q>{i, x, v), + D V (i, x)) - (b(i, y , v), ^p^: 

+ 

< 0. 



2(x — y) - - \ {- - 2(x — y) 
g { t, x, ui{t, x), [ + D<p(t, x)]a(t, x,v)\ -g[t,y, u 2 (t, y), a(t, y, v) 
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Using (4.7) and Lipschitz condition, we analysis the items in the sup^g^ and get 

- ^(t, x) sup jl(| + 5^)L 2 \x y\ 2 + 1(1 + 5^)Tr ((<?<? T )(i, x, v)D 2 ip{t, x)) 



+ ±5^(\a(t,x,v)\ 2 + \a(iy,v)\ 2 ) + Utt ((aa T )(t,x,v)(D^) 2 (t,x)) 
+ 2L \- ~J\ + {b(i,x,v),Dip(i,x)) + L\x-y\ + L\m(t,x) -u 2 (i,x)\ 
+L\u 2 {i,x) - u 2 (i,y)\+L\Dip(i,x)a(i,x,v)\ + 2L 2 ^ ~ ^ | < 0. 

We let 5 — > + , then let e — > + and we get 
5 fl 

--ar(*o, ^o) - sup <^ -TV ((crcr T )(t , zo, v)D 2 <p(t , x )) + (b(t , x , v), Dip(t , x )) 
at ve u 1 z 

+L\w(t ,x )\ + L\Dip(to,Xo)o-(to,x ,v)\} < 0. 

Therefore w is a viscosity subsolution of the desired equation (4.6) and the proof is completed. 

Now we are going to construct one suitable smooth supersolution for the equation (4.6). 
Lemma 4.9 For any A > 0, there exists C\ > such that the function 

X (t,x)=exp{{C 1 (T-t) + A)i,{x)}, 

where 



1 2 

1 



1>(x) = [log((|af + l)5 
satisfies 

d x \ 
X%x),- — {t,x) - sup {£(t,x,v)x(t,x) + L X (t,x) + L\V xv (t,x,v)\} > 
ot ve u J 

in [fi,T] x R n where ti=T- (A/d). 

Proof: Obviously, the function x defined in the Lemma satisfy x{t-> x ) > 0; f° r each {t, a 
[0, T] x R". We give estimations on the first and second order derivatives of ip: 

\Di>{x)\ < 2[ ^ (X)]2 1 and \D 2 i>{x)\ < ° i 1 + ^ X ^ ) j R n 
" (|a;| 2 + l)^ ' Wl " M 2 + l 

These estimations imply that, if t e [ii,T], 

\D X (t,x)\ <C X (t,x) M X)] * , \D 2 x(t,x)\<C X (t,x) " ' 1 



(|a;| 2 + l)2 \x\ 2 + l 
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where the constant C only depend on A. We continue to calculate 

-rrr(t,x) + sup {C(t,x,v)x(t,x) + L X (t, x) + L\Vx^{t, x, v)\} 
at v( zu 

= §(t, x) + sup ( \Tr{{aa T )D 2 X ) + (6, D X ) + L X (t, x) + L\V X <r(t, x, 



St 



1 W(t,x,v)\ 2 
leu 12 M 2 + l 



(4.8) 



< -C lX (t, ar)^(x) + sup ^ - ' , v .' 2 \ ? C X (t, x)^{x) 



(M 2 + l)* (|x| 2 + l)3 

Because b and cr are linear growth in x, [ip(x)]i < ip(x) and 1 < ^(x), the above inequality (4.8) 

< -dx(t, x)i/>(x) + \cx{t, x)i>{x) + C X (t, x)i>{x) + L X (t, x)%l>(x) + LC X (t, x)^{x) 
= ~(Ci -\c-C-L- LC) X {t, x)^{x). 

It is clear that when C\ large enough the quantity in the right side of the above inequality is negative 
and the proof is completed. □ 

Now we can prove the uniqueness result for viscosity solution of (4.1). 

Theorem 4.10 Assume that b, a, g, $ and h satisfy (H3.1)-(H3.4), respectively. Then there exists 
at most one viscosity solution of HJB equation (4-1) in the class of continuous functions which grow 
at most polynomially at infinity. 

Proof: Let U\,U2 £ C([0, T] x R") be two viscosity solutions of HJB equation (4.1). 
We define w :— u\ — U2, then we have 

lim w(t,x)e- A ^^+ 1 ^ =0 

►oo 

uniformly for t £ [0, T], for some A > 0. This implies, in particular, that w(t, x) — ax{t, x) is bounded 
from above in [t\ , T] x R" for any a > and that 

M := max (w - a X )(t, x)e~ L( - T ~^ 

[ti,T]xR" 

is achieved at some point (to, xq) £ [ti,T] x R" (depend on a). Then we have two case. 

The first case: w(to,xo) < 0. 
Then we have 

ui(t,x) - u 2 (t,x) < a X (t,x), (t,x) £ [ti,T] x R™. 
Letting a tends to zero, we obtain 

ui(t,x) < u 2 (t,x), (t, x) £ [t\,T] x R". (4.9) 
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The second case: w(to,Xo) > 0. 
Then we have 



w(t,x)-a X (t,x) < (w(t 0l x ) - a X {t ,x ))e- L(t - ta \ (t,x) G [h,T] x R™. 

We define 

<p(t,x) = a X {t,x) + (w(t ,x ) - ax(£o,a:o))e~ L(t ~* o) , 

and can get 

w-<f<0 = (w- (p)(t ,x ), (t,x) G [h,T} x R™. 
Since ip(to, Xo) — w(t , x ) > and Lemma 4.8, when to G [ti,T), we have 

d(p f 1 

- -^-(t ,x ) - sup <^ -Tr ({aa T )(t , x , v)D 2 ip(t ,x )) + (b(t , x , v), Dtp(t ,x )) 
at v< zjj ^ i 

+ Ltp(t ,x ) + L\V(p(t ,xo)a(t ,XQ,v)\} < 0. 
From the definition of ip, we rewrite the above inequality 

— (t ,x ) - sup <^ -Tr ((aa T )(to,x ,v)D 2 X (to,Xo)) + (b(t , x , v), Dx(t , x a )) 



at ve u i z 

+Lx{to,x a ) + L\Vx(to, x a )a(tQ, x a ,v)\}] < 0. 

This is a contradiction with Lemma 4.9. Therefore to = T, this is a contradiction with the fact that 
w(t,x) is a viscosity subsolution of (4.6) (see Lemma 4.8). Then the second case does not happen. 

If we change w(t, x) = u\ — u 2 for w'(t, x) = u 2 — u\, the same argument leads to 

u 2 (t,x) <m(t,x), (t, x) G [h,T] x R". (4.10) 
Combining (4.9) with (4.10), we have 

u x {t,x) = u 2 (t,x), (t,x) G [h,T] x R". 

Applying successively the same argument on the intervals {t 2 ,t{\ where t 2 = (ti — A/C\) + and 
then, if t 2 > on [£3^2] where £3 = (t 2 — A/C\) + ... etc. We finally obtain that 

ui (t, x) = u 2 (t, x), (t, x) G [0, T] x R™. 

The proof is complete. □ 

Appendix 

In the appendix we give the proof of Proposition 2.1 and 2.2. 
Proof of Proposition 2.1 
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Applying Ito's formula to the process |y s | 2 e^ s yields 

n 



\Y t \ 2 e^ + J (P\Y s \ 2 + \Z s \ 2 )e^ds 

= |£|V T + 2^ Y B g{a,Y B ,Z s )eP'd8 + 2 J Y s e> 3s dK s -2^ Y s Z s e f3s dW s 

= |£|V T + 2 f Y s g(s, Y s ,Z s )e f3s ds + 2 f S s e f3s dK s - 2 f Y s Zj 3s dW Sl 
Jt Jt Jt 

where we have used the identity (Y a — S s )e l3s dK s = 0. Using the Lipschitz property of g, we have 



\Y t \ 2 e^ + J (f3\Y s \ 2 + \Z s \ 2 )e? s d S 

<\t\ 2 e f3T + 2 J \Y s \\g{s,Y s ,Z s )\e f3s ds + 2 £ \S a \e^ s dK a -2 J Y s Z s e f3s dW s 

<|£|V T + 2 f T \Y s \\g(s,0,Q)\eP'ds + 2 [ T (L\Y a \ 2 + L\Y a \\Z a \)e?'ds 
Jt Jt 

+ 2^ \S s \e f3s dK s -2 Y s Z^ 3s dW s 
< |£|V T + 2^ \Y s \\g(s, 0, 0)|e"'ds + jT ({2L + 2L 2 )\Y S \ 2 + l -\Z s \ 2 ^j ef'ds 

,T ,T 

+ 2/ \S s \e f3s dK s -2 Y a Z a e p 'dW a . 
Jt Jt 

We select (i = 2L 2 + 2L, then 

NV' + i J T \Z s \ 2 ef }s ds<\ee f3T + 2 J T \Y s \\g(s, 0, 0)|e"'<fc 

+ 2 J \S a \e> 3s dK a -2 J Y s Z s e f3s dW s . 

|^ T |Z s |V s da| <2E^||e| 2 e ^ T + 2^ T |y s || ff ( S ,0,0)|e^ S 
+2^" IS.I^dK-.j. 

sup \Y u \ 2 e 0u < |£|V T + 2 / T |y a || 5 ( 5 ,0,0)|e^d a 

+ 2 / |S s |e' 3 W s +4 sup | / Y a Z,e?'dW a \. 

Jt t<u<T Jt 



(A.l) 



(A.2) 
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From Burkholder-Davis-Gundy's inequality we have 

E^( sup |F„|V U 1 <E^* | |£|V T + 2 / T |y 8 || ff (s,0,0)|e^dfl 

U<u<T J [ Jt 

+2 jT |5 a |e^W a | + CE^ ^jT \Y s \ 2 \Z s \ 2 e 2 ^ds^j , 
thanks to the inequality ab < a 2 /2 + fc 2 /2, we deduce immediately 

sup <E^' ||£|V T + 2 / T |F s || ff (s,0,0)|e^s + 2 Tl^le^wJ 

U<u<T J [ Jt Jt J 

+ ^E* j jf |Z s |V s d s j + \^ | 4< sup r |r„| V"} . 
Combining the inequality (A. 2) with the above one, we easily derive that 
E^| sup \Y u \ 2 e' 3u + [ \Z s \ 2 e^ s ds\ 

[t<u<T Jt I 

<CE^ ||C| 2 e' 3T + ^ T |i;|| 3 ( S ,0,0)|e^d S + 2^ T |^| e ' 3 W s |. 
Using the fact that 

CE^ J jT \Y s \\g(s, 0, 0)\e?'da 1 < j^sup^ |y„| V J + ^E^' ( jT \g(s, 0, 0)| e W 2 ) s rf S 



we get 



E^J sup |y u |V + [ T \Z s \ 2 e^ds\ 

[t<u<T Jt J 



<CE^||e|V T + ^ \g( S ,0,0)\e W2)s d S ^j + 2 ^ ' \S s \e^dK s 
Then we drop the exponential function to get a brief form 
Ef< | sup \Y U \ 2 + [ \Z s \ 2 ds\ 

[t<«<T Jt J 

<CE* ||e| 2 + ^ T | 5 (s, 0,0)|^ +2^ T |5 s |rf^ s |. 
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(A.3) 



We now give an estimate of IE- 77 * [\Kt — K t \ 2 ]. From the equation 



K T -K t = Y t -i- J g(s,Y s ,Z s )ds + J Z ( 



dW s , 



and estimate (A. 3), we get the following inequalities: 



E^{\K T -K t \ 2 } KCEf* j|£| 2 + ^ \g{s,0,0)\cbj +2^ \S s \dK s 

<CE* j|£| 2 + ^ \g{ 8 ,0,0)\cbj 
+ 2C 2 E^( sup \S S \ 2 } + \^{\K T -K t \ 2 }. 

{t<u<T J ^ 

Consequently, 

E^{|if T -^| 2 } <CE^* ||e| 2 + ^ T | 5 (s,0,0)|dsj + t< sup r |5 s | 2 |. (A.4) 

Combining the estimate (A. 3) with (A.4), we complete the proof of the proposition. □ 

Proof of Proposition 2.2 

The computation process is similar to that in the proof of Proposition 2.1, so we shall only give 
the sketch of the proof. Since J^(AY S - AS s )e l3s d(AK s ) < 0, 

|AF t | e ' 3t + J T (P\AY S \ 2 + \AZ s \ 2 y s ds 
< \A^\ 2 e pT + 2 j AY s Ag(s, Y s , Z a )e p 'da 

+ 2 J AY s [g'(s, Y S ,Z S ) - g'(s, Y'„ Z' s )]e?'ds 

+ 2^ AS s e f3s d{AK s )-2 AY s AZ s e 0s dW s 
< \ At\ 2 e? T + 2 £ \AY s \\Ag( S ,Y s ,Z s )\eP s ds 

+ 2L j\\AY s \ 2 + \AY s \\AZ s \)e' 3s ds 

+ 2^ \AS s \e 0s d(K s +K' s )-2 J AY s AZ s e (3s dW s . 



Similar technique with the above proof of Proposition 2.1, we can get 




+ (V | t< sup^ |A^| 2 |y /2 (E* {((K T - K t ) (K' T K' t )f}) 1/2 . 

And then from Proposition 2.1, we complete the proof. □ 
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